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LIVING ON THE MULTI-DIMENSIONAL EDGE: 
SEEKING HIDDEN RISKS USING REGULAR VARIATION 

By Bikramjit Das*, Abhimanyu Mitra"!" and Sidney Resnick^ 
ETH Zurich, Cornell University and Cornell University 



Multivariate regular variation plays a role assessing tail risk in 
diverse applications such as finance, telecommunications, insurance 
and environmental science. The classical theory, being based on an 
asymptotic model, sometimes leads to inaccurate and useless esti- 
mates of probabilities of joint tail regions. This problem can be partly 
ameliorated by using hidden regular variation [Resnick, 2002, Mitra 
and Resnick, 2010]. We offer a more flexible definition of hidden reg- 
ular variation that provides improved risk estimates for a larger class 
of risk tail regions. 



1. Introduction. Daily we observe environmental, technological and fi- 
nancial phenomena possessing inherent risks. There are financial risks from 
large investment losses; environmental risks from health hazards resulting 
from high concentrations of atmospheric pollutants; hydrological risks from 
river floods. Risk analysis requires estimation of tail probabilities that pro- 
vide measures of such risks. The mathematical framework of multivariate 
regular variation provides tools to compute tail probabilities associated with 
such risks; see Resnick [2007], Joe and Li [2010], Cai et al. [2011]. These tools 
have limitations which we begin to address in this paper. 

Consider a non-negative random vector Z = (Z 1 , Z 2 ,- ■ ■ ,Z d ) called a 
risk vector. The distribution of Z has multivariate regular variation if there 
exist a function b(t) f oo and a non-negative non-degenerate Radon measure 
//(•) on E = [0, oof \ {(0, 0, • • • ,0)} such that as t -> oo, 



where — > denotes vague convergence in M + (E), the set of all Radon mea- 
sures on E [Resnick, 2007, page 172]. Note that (1) effectively assumes tail 
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equivalence of the marginal components [Resnick, 2007, Section 6.5.6], so 
while (1) is valuable as a theoretical foundation it must be modified for 
applications. 

The asymptotic relation (1) allows the limit measure //(•) to be used for 
approximating tail probabilities. For example, approximation of the proba- 
bility of the event {Z l > x l for some i} for large thresholds x l , i = 1, 2, • • • , d 
requires the ability to compute \x ({{z 1 , ■ ■ ■ ,z d ) G E : z % > w % for some i}) 
for w % > 0, i = 1, 2, • • • , d. Such approximations of tail probabilities are sensi- 
tive to degeneracies in the limit measure //(•)• For example, when asymptotic 
independence is present as in Gaussian copula models, the limit measure /x(-) 
in (1) concentrates on the coordinate axes Li := {x G R d : x^ = Vj ^ 
i},i = l,...,d, and \i ({(z 1 , z 2 , ■ ■ ■ , z d ) G E : > w 1 , z j > w 2 ) = for any 
l<z < j<d and w l ,w 2 > 0. Consequently, we would approximate the joint 
tail probability 

P{Z i > x\Z j > x 2 ) w 

for large thresholds rE 1 ,^ 2 and conclude risk contagion is absent. This con- 
clusion may be naive and hence the concept of hidden regular variation 
(HRV) was introduced [Resnick, 2002] which offered a refinement of this ap- 
proximation; see Maulik and Resnick [2005], Heffernan and Resnick [2005], 
Mitra and Resnick [2010] and the seminal concept of coefficient of tail de- 
pendence in Ledford and Tawn [1996, 1998]. 

The definition of hidden regular variation offers some strengths but also 
has weaknesses. The existing definition provides insight only in the presence 
of a restricted class of degeneracies in the limit measure //(•) in (1); namely 
when /i(-) concentrates either on the coordinate axes, or the coordinate 
planes or similar coordinate hyperplanes in higher dimensions. However, 
other degeneracies in /i(-) are possible; for example, /x(-) may be concen- 
trated on the diagonal {(z l , z 2 , ■ ■ ■ , z d ) G E : z 1 = z 2 = ■ ■ ■ = z d }, a 
condition called asymptotic full dependence. To deal with such degeneracies 
and situations where \i may place zero mass on large portions of the state 
space, we define in Section 3 hidden regular variation on cones. For us, a 
cone C in H d is a set C C M d satisfying x G C implies tx G C for t > 0. 

In practice, different risk assessment problems require calculating tail 
probabilities for different kinds of events. Hidden regular variation, as pre- 
viously defined, may be a natural choice for some calculations but not for 
others. For example, suppose (Z 1 , Z 2 ) G is a risk vector and we must cal- 
culate risk probabilities of the form P — Z 2 \ > for large thresholds 
w > 0. If we use multivariate regular variation when the limit measure /x(-) 
in (1) is concentrated on the diagonal {(z 1 , z 2 ) G E : z 1 = z 2 }, the tail prob- 
ability P (\Z l — Z 2 \ > in) must be approximated as zero for large thresholds 
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w > 0. The existing notion of hidden regular variation designed to help when 
\i concentrates on the axes cannot offer a refinement in this case. Example 
5.2 of Section 5 illustrates how a more general theory overcomes this diffi- 
culty. This along with other examples in Section 5 emphasize the need for 
the theory of hidden regular variation on general cones. 

The conditional extreme value (CEV) model [Heffernan and Tawn, 2004, 
Heffernan and Resnick, 2007, Das and Resnick, 2011] provides one alter- 
native approach to multivariate extreme value modeling. In standard form, 
the CEV model can also be formulated as regular variation on a particular 
cone in E and this is discussed in Section 4. Also in Section 4, we consider 
non-standard regular variation from the point of view of regular variation on 
a sequence of cones. Non-standard regular variation is essential in practice 
since in applications we cannot assume tail-equivalence of all marginals in a 
multivariate model as is done in (1). 

Section 6 discusses how to fit our model of HRV on cones to data as well as 
estimation techniques of tail probabilities using our model. We have adapted 
ideas previously used in multivariate heavy tail analysis and this discussion 
is not comprehensive, merely a feasibility display. In particular we have not 
performed data analyses. We close our discussion with concluding remarks 
in Section 7 and give some deferred results and proofs in Section 8. 

Our definition of HRV relies on a notion of convergence of measures called 
M*-convergence that is similar to Mo convergence of Hult and Lindskog 
[2006]. This M* -convergence is developed in Section 2 where we also dis- 
cuss reasons to abandon the standard practice of defining regular variation 
through vague convergence on a compactification of M. d . 

1.1. Notation. We briefly discuss some frequently used notation and con- 
cepts. 

1.1.1. Vectors, norms and topology. Bold letters are used to denote vec- 
tors, with capital letters reserved for random vectors and small letters for 
non-random vectors, e.g., x = (x l ,x 2 , ■ ■ ■ ,x d ) S M d . We also denote 

= (0, 0, • • • , 0), 1 = (1, 1, • • • , 1), oo = (oo, oo, • • • , oo). 

Operations on and between vectors are understood componentwise. For ex- 
ample, for vectors x, z, 

x < z means x l < z l , i = 1, . . . , d. 

For a set A C [0,oo) d and x £ A, use [0,x] c to mean [0,x] c = -A\[0,sc] = 
{y G A : vf =1 y l /x l > 1}. When we use the notation [0, x] c , the set A should 
be clear from the context. 
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For the i-ih largest component of x, we write that is, x^ > x^ > 
■ ■ ■ > x^ . Thus a superscripted number i denotes the i-th component of 
a vector, whereas a superscripted (i) denotes the i-th largest component in 
the vector. 

Operations with oo are understood using the conventions: 

00 + 00 = 00, 00 — 00 = 0, for x£i, 00 + x = 00 — x = 00, 

O.00 = 0, for x > 0, x.oo = 00, for x < 0, x.oo = —00. 

Fix a norm on R d and denote the norm of x as Let d(x,y) = 

|| x — y || be the metric induced by the norm and, as usual, for A C M. d , 
set d(x,A) = infygA d(x, y). When attention is focused on the set C, and 
A C C, the (5-dilation or swelling of A in C is A 5 := {x G C : d(x, A) < 5}. 
The topology on M. d is the usual norm topology referred to as the Euclidean 
topology and the topology on a subset of M d is the relative topology induced 
by the Euclidean topology. 

Two sets A and B in R d are bounded away from each other if in B = 0, 
where A and B are the closures of A and B. 

1.1.2. Cones. We denote by E = [0, oo] d \ {0} and D = [0, oo) d \ {0}, 
the one point puncturing of the compactified and uncompactified versions of 

. The symbols E and D may appear with superscripts denoting subsets of 
the compactified and uncompactified IR+ respectively. For example, E^ = 
{x G [0, oo] d : > 0} and DW = {x G [0, oo) d : > 0}, where is the 
Z-th largest component of x. Note E^ = E. 

A set C C M. d is a cone if x G C implies tx G C for all t > 0. Cones 
in the Euclidean space are usually denoted by mathematical bold symbols 
C,D,E,F, etc. Since one typically deals with non-negative risk vectors, we 
focus on the case where C C [0,oo) d . Call a subset F C C a closed cone in 
C if F is a closed subset of C as well as a cone. Example: F = {0} or when 
d = 2, F = {(i, 0) : t > 0}. The complement of the closed cone F in C is an 
open cone in C; that is, the complement of F is an open subset in C as well 
as a cone. 

Fix a closed cone C C [0, cc) d containing and suppose F C C be a 
closed cone in C containing 0. Then O := C \F is an open cone and C and F 
are complete separable metric spaces under the metric d(-, •). Let C denote 
the Borel a- algebra of C. Clearly O is again a separable metric space (not 
necessarily complete) equipped with the cr-algebra O = {B C O : B G C}. 

Examples: (i) C = [0, oo) d , F = {0} and then O = D = [0, oo) d \ {0}. (ii) 
d = 2, C = [0, oo) 2 , F = {(0, x) : x > 0} U {(y, 0) : y > 0}, O = (0, oo) 2 . (hi) 
d = 2, C = [0, oo) 2 , F = {(x, 0) : x > 0}, and O = D n := [0, 00) x (0, 00). 
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1.1.3. Regularly varying functions. A function U : [0, oo) h-> [0, oo) is 
regularly varying with index /3 € R if for all x > 0, 



We write U G RVp. See Resnick [2008], de Haan and Ferreira [2006], Bing- 
ham et al. [1987]. 

1.1.4. Vague convergence of measures.. We express vague convergence 
of Radon measures as A ([Resnick, 2007, page 173], Kallenberg [1983]) and 
weak convergence of probability measures as =>• [Billingsley, 1999, page 14]. 
Denote the set of non-negative Radon measures on a space § as M+(§) and 
the set of all non-negative continuous functions with compact support from 
§ to R+ as C£(S). 

Vague convergence on E has traditionally been used when defining mul- 
tivariate regular variation. We explain in the next section why continuing 
with this practice is problematic and what should be done. 

2. M*-convergence of measures and regular variation on cones. 

This paper requires a definition of multivariate regular variation on cones 
of the Euclidean space which differs from the traditional definition through 
vague convergence of measures. Following Hult and Lindskog [2006], we de- 
fine regular variation based on a notion of convergence of measures we call 
M*-convergence. 

2.1. Problems with compactification of M. d . Multivariate regular varia- 
tion on [0, oo)'' is usually defined using vague convergence of Radon measures 
on E = [0,oo] d \ {0} [Resnick, 2007]. The reason for compactifying [0,oo) d 
and then removing is this makes sets bounded away from {0} relatively 
compact (cf. [Resnick, 2007, Section 6.1.3]) and since Radon measures put 
finite mass on relatively compact sets, this theory is suitable for estimating 
probabilities of tail regions. 

The theory of hidden regular variation may require removal of more than 
just a point. Furthermore, compactifying from [0,oo) d to [0, oo] d introduces 
problems. For one thing, it is customary to rely heavily on the polar coor- 
dinate transform 




= X 1 




which is only defined on [0, oo) d \ {0} and if the state space [0, oo\ d \ {0} 
is used an awkward kluge [Resnick, 2007, page 176] is required to show 
the equivalence of regular variation in polar and Cartesian coordinates. A 
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workaround is only possible because the limit measure fi in (1) puts zero 
mass on lines through infinity {x : vf =1 x l = 00} but absence of mass on 
lines through 00 does not necessarily persist for regular variation on other 
cones [Mitra and Resnick, 2010]. 

Also, compactification introduces counterintuitive geometric properties. 
For example, the topology on [0, 00] can be defined through a homeomor- 
phic map [0, oo] d t— > [0, l] d , such as 

z = (z 1 , z 2 , ■ ■ • , z d ) 1 y (z7(± + z 1 ), . . . , z d /(l + z d )) . 

Restrict attention to d = 2 and consider two parallel lines in [0, 00] 2 with the 
same positive and finite slope. These lines both converge to the same point 
(00, 00) and therefore in the compactified space, these two parallel lines are 
not bounded away from each other. Interestingly, this is not the case if the 
lines are horizontal or vertical. 

To see the impact that parallel lines not being bounded away from each 
other can have recall one of the motivational examples from Section 1 with 
d = 2, where the limit measure ^(-) in (1) is concentrated on the diagonal 
DIAG := {(z , z 2 ) E E : z 1 = z 2 } and we need to approximate the tail prob- 
ability P [\Z l — Z 2 \ > w) for a large threshold w > 0. Of course, if we use 
multivariate regular variation as in (1) to approximate P (\Z l — Z 2 \ > w), 
we approximate P — Z 2 \ > w) as zero. If P\Z X = Z 2 \ < 1, this ap- 
proximation is crude. Following the usual definition of HRV, we remove the 
diagonal DIAG and define regular variation on the sub-cone (DIAG) C := 
{(z l ,z 2 ) E E : z l 7^ z 2 }. Since we seek to approximate P (\Z l — Z 2 \ > w), 
we are interested in the set A >w := {(z 1 ,^ 2 ) € E : jz 1 — z 2 \ > w}. If we 
define HRV on the sub-cone (DIAG) C as an asymptotic property using vague 
convergence, we need the set A >w to be relatively compact in the sub-cone 
(DIAG) C . However, if the sub-cone (DIAG) C is endowed with the relative 
topology from the topology on [0, oo] 2 , A >w is not relatively compact since 
the boundaries of A >w are the two parallel lines {(z 1 , z 2 ) G E : z 1 — z 2 = w} 
and {(z 1 ,^ 2 ) G E : z 1 — z 2 = —w}, which are both parallel to the diagonal 
DIAG. In the topology of [0,oo] d , the boundaries of the set A >w are not 
bounded away from the diagonal DIAG and hence by Proposition 6.1 of 
[Resnick, 2007, page 171], the set A >w is not relatively compact in (DIAG) C . 

As already observed, horizontal or vertical parallel lines are bounded away 
from each other in [0, 00] 2 . If the limit measure //(•) in (1) concentrates on the 
axes, the traditional definition of HRV [Resnick, 2002] removes the axes and 
defines hidden regular variation on the cone (0,oo] 2 . However, risk regions 
of interest of the form (z^oo] x (z 2 ,oo] are still relatively compact and we 
do not encounter a problem as above.. 
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Thus, we conclude that a flexible theory of hidden regular variation on 
general cones of [0, oc) d requires considering the possibility that compactifi- 
cation and vague convergence be abandoned. However, without compactifi- 
cation, how do we guarantee risk sets corresponding to tail events are rela- 
tively compact and their probabilities approximable by asymptotic methods? 
A theory based on M* -convergence of measures sidesteps many difficulties. 

2.2. M* -convergence of measures. We follow ideas of Hult and Lindskog 
[2006] who removed only a fixed point from a closed set, whereas we remove 
a closed cone. 

As in Section 1.1.2 we fix a closed cone C C [0,oo) d containing and 
F C C is a closed cone in C containing 0. Set O := C \ F, which is an 
open cone in C. Let C be the Borel cr-algebra of C and the cr-algebra in O is 
O = {B C O : B £ C}. Denote by Cw the set of all bounded, continuous real- 
valued functions / on C such that / vanishes on F' r := {x £ C : d(x,¥) < 
r} for some r > 0. The class of Borel measures on O that assign finite 
measure to all D £ O which are bounded away from F is called M*(C,0). 
Equivalents, ^ £ M*(C, O) if and only if fi is finite on C \ F r for all r > 0. 

Definition 2.1 (M*(C, 0)-convergence). For fj,,n n £ M*(C,0),n > 1, 
/i„, converges to [i in M*(C,0) if 

(2) lim fi n (B) = fi(B), 

n— >oo 

for all B £ O with fJ,(dB) = and B bounded away from F. We write 
/i n A /x in M*(C, O) as n -> oo. 

We can metrize the space M*(C,0). One method: For fi, v £ M*(C,0) 
define 

(3) **M:=J o ^ 1 + dp ^ {r)Mr)) dr, 

where are the restrictions of fi, v to C \ F r and dp is the Prohorov 

metric [Prohorov, 1956]. 

Following Hult and Lindskog [2006], (M*(C,0), dm*) is a complete sepa- 
rable metric space and the expected analogue of the Portmanteau theorem 
[Billingsley, 1999] holds: For pL n £ M*(C,0),n > 0, the following are equiv- 
alent: 

1. [i n A fi in M*(C, O) as n -)■ oo. 

2. For each / £ Cw, f fdfi n — > f fdfiQ as n — > oo. 

3. limsup^oo Hn(A) < fio(A) and liminf^oo ^ n {G)_ > no(G) for all 
closed sets A £ O and open sets G £ O such that G n F = 0. 
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3. Regular and hidden regular variation on cones. We define reg- 
ular variation on a nested sequence of cones, where each cone is a subset 
of the previous one. Each cone in the sequence possesses a different regu- 
lar variation, which remains hidden while studying regular variation on the 
bigger cones in the sequence. 

3.1. Regular variation. We use the concepts of Section 2 to define regular 
variation. 

Definition 3.1. Suppose F C C C [0, oo) d and ¥ and C are closed cones 
containing 0. A random vector Z S C has a distribution with a regularly 
varying tail on O = C \ F, if there exist a function b(t) f oo and a non-zero 
measure v(-) € M*(C,0) such that as t — > oo, 



(4) tP 



Z 



!/(•) inM*(C, 



When there is no danger of confusion, we sometimes use the notation M 
to mean M*(C,0) and sometimes abuse language and say the distribution 
is regularly varying on O. 

Definition 3.1 implies there exists a > such that 6(0 G RV\/ a and that 
v has the scaling property: 

(5) v(c-)=c- a v(-), c>0. 

This can be derived as in [Hult and Lindskog, 2006, Theorem 3.1]. We define 
standard multivariate regular variation, hidden regular variation and the 
conditional extreme value model in terms of Definition 3.1 and attempt to 
relate each to the way these ideas were first proposed on modifications of 
compactified spaces. 
Examples: 

1. Let C = [0,oo) d and F = {0} and D = O = [0,oo) d \ {0}. Regular 
variation on D is equivalent to regular variation defined in (1) on E. 
The definition in (1) precludes jx having mass on the lines through oo. 
See Appendix 8.1. 

2. Let d = 2, C = [0,oo) 2 and F = {(x,0) : x > 0} U {(0,y),y > 
0} and O = (0,oo) 2 , the first quadrant with both the x and y axes 
removed. This is the restriction to [0, oo) 2 of the cone used in the 
definition of hidden regular variation in Resnick [2002]. For d > 2, 
other examples of F are in Mitra and Resnick [2010] and Subsection 
8.2 provides a comparison between regular variation defined in (4) on 
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DW = [0, oo) d \ {x G [0, oo) d : > 0} and regular variation defined 
using (1) on = [0, oo] d \ {a: G E : > 0} where recall is the 
Ith largest component of x. The two notions are equivalent provided 
there is no mass on E^' \D®. 

3. Suppose d = 2 and C = [0,oo) d and F = {(x,0) : x > 0}. Then 
O = {(x,y) G [0,oo) 2 : y > 0} = D n) the first quadrant with the 
x-axis removed. This is the restriction to [0, oo) 2 of the cone used in 
the definition of the conditional extreme value model [Heffernan and 
Tawn, 2004, Heffernan and Resnick, 2007, Das and Resnick, 2011]. 

4. Suppose d = 2 and C = [0,oo) d and F = {(x,x) : x > 0}. Then O is 
the first quadrant with the diagonal removed. This example is suitable 
for discussing asymptotic full dependence (Resnick [2008, page 294], 
Resnick [2007, page 195]) and is considered in Example 5.2. 

3.2. Spectral measures, unit spheres and semi-parametric representations. 
Regular variation on E using the vague convergence definition as in (1) 
allows a polar coordinate transformation x \— > (||x||,x/||a;||). Assuming 
&(•) G RVx/a, the limit measure has the scaling property and when this 
is expressed in polar coordinates yields the version of (1) 

\\z\\ z 

t b(^) G dX ' JzJ\ G ^ ax a ldx x s *(d a ) 

where S* is a finite measure on = {a G E : |a|| = 1}, the unit sphere. 
Fixing S*(dH) = c, we define S(-) = S*(-)/c which becomes a probability 
measure on called the spectral or angular measure. So in polar coordi- 
nates, the limit measure fi in (1) has a semi-parametric product structure 
depending on the parameter a and the measure S. 

In E, the unit sphere <9N = {x G E : = 1} = {x G E : d(x, 0) = 1} is 
compact. However, this may no longer be true when moving to other sub- 
cones. For instance in (0, oo] 2 the usual unit sphere is not relatively compact. 
While the polar coordinate transformation still allows this semi-parametric 
representation for other cones, the analogue of S is no longer necessarily fi- 
nite and this is a problem for inference. We explain next how to use a change 
of coordinates different from the polar coordinate transformation which al- 
ways produces a finite spectral measure analogue. Heffernan and Resnick 
[2007] and Mitra and Resnick [2010] consider alternatives to the polar co- 
ordinate transformation that twist limit measures into a semi-parametric 
form. 

Proceed using the context of Definition 3.1. Assume C, F and O are defined 
as in Definition 3.1 and define = {x G O : d(x, F) > 1} and is a subset 
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of O bounded away from F and U|g > o}^^o = CD- From Definition 3.1, we 
have < ^(Nq) < oo. The scaling property (5) implies the scaling function 
b(t) in (4) can be chosen so that so that f (No) = !• Define the related set 
dtt = {xeO: d{x,¥) = 1}. 

Examples: (i) C = [0,oo) d and F = {0} and d(x,¥) = \\x\\ and <)\i- = 
{x : \\x\\ = 1}. (ii) d = 2, ||a;|| =i 1 Vi 2 ,C = [0, oo) 2 and F = {(x, 0) : x > 
0} U {(0,y),y > 0} and O = (0,oo) 2 . Then <9N = {x : d(x,¥) = 1} = {x : 
x 1 Ax 2 = 1}. (iii) d = 2, = x 1 Vx 2 , and C = [0,oo) d and F = {(x,0) : 
x > 0}. Then dK = {x : d(x, F) = 1} = {(x, y) : x > 0, y = 1}. 

We transform to an appropriate coordinate system in which the limit 
measure v in (4) is a product of two components: a one- dimensional Pareto 
measure and a probability measure defined on <9No called the hidden spectral 
or angular measure. To do this note two properties of the distance function 
d(-,¥): 

(i) Since F is a closed subset of C, d(x,¥) > for all x G O (else x £ F); 
and 

(ii) Since F is a cone, 9 • F = F for 9 > 0. Hence, d(9x,¥) = d{9x,9¥) = 
6d(x,¥), that is d(-,¥) is homogeneous of order 1. 

A lemma is necessary for the decomposition of limit measure v(-). For a 
set A e [0, oo) d we set (A) 1 = {x 1 : x E A}. 

Lemma 3.2. Suppose h : O i— > (0,oo) x <9N© is a continuous bisection 
satisfying 

(i) For every measurable A C (0, oo) x 9No with (A)i n {0} = 0, h~ 1 (A) 
is bounded away from ¥. 

(ii) For every measurable B C O with B bounded away from ¥, (h(B))i n 
{O} = 0. 

Then, the following statements are equivalent: 

(i) As t — > oo, 

l*t(.)A/i(.) in M*(C,0). 

(ii) For all measurable A C (0, oo) x <9N© such that (A)i n {0} = and 
HohT 1 {dA) = 0, 

/it o h~ 1 (A) -> fio h' 1 (A). 

Proof. The proof follows the steps of the proof of Theorem 2.5 of Hult 
and Lindskog [2006]. □ 

Now by applying Lemma 3.2 with h : x \— > (d(x,¥),x/d(x,¥)), we are 
able to decompose v as follows. 
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Proposition 3.3. Regular variation on O as given in (4) is equivalent 

to 



(6) tP 



b(t) 'd(Z,F) ' ~ 



o>( a ) x S©(A) 



/or aZZ measurable A C (0, oo) x <9Nq suc/i i/iai (-A)i H {0} = and o 
/i _1 (cL4) = where c > 0, So(-) is a probability measure on cMq and f( a )(-) 
is i/ie Pareto measure given by vr a \((x, oo)) = /or x > 0. CaZZ SbQ £/&e 
spectral measure on O; it is related to u{-) by the relation 



(7) 5 (A) 



i/(i60: d(x,F) > 1) 



Since (0, oo) x cMq is not a cone, we have not phrased the convergence in 
(6) as M* convergence as in (4). To do so would require more reworking of 
the convergence theory in Hult and Lindskog [2006]. 

Corollary 3.4. The convergence in (4) is equivalent to the following 
two conditions: 

(i) The distribution of d(Z,¥) is regularly varying on (0, oo) following 

Definition 3.1 with C = [0,oo). 
(ii) The conditional distribution of Z/d(Z,¥) given d(Z,¥) > t, converges 
weakly, 

P [Z/d(Z, ¥) € • | d(Z, ¥) > t] => Sq(-) (t -> oo). 

Remark 3.5. We make a few remarks about Proposition 3.3. 

(i) On the role of the distance function: Proposition 3.3 emphasizes that 
the spectral probability measure Sq(-) is dependent on the choice of 
distance function d(-, •). Corollary 3.4 allows us to use the distance 
function d(-, •) to detect regular variation on O; see Section 6. However, 
extending the distance function to a compactified space such as [0, oo] d 
is difficult and this provides another reason why we deviated from the 
standard discussion of regular variation using compactified spaces and 
vague convergence. 

(ii) Connections to prior treatments: 

(a) Proposition 3.1 of Mitra and Resnick [2010] decomposes the limit 
measure on E^ (see (29) below) by applying the trans- 

formation T : x H > (x( l \x/x®) , where is the l-th largest 
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component of x. If we choose C = [0, oo) d , F = {x G C : x^ 1 ' = 0} 
and O = {a; E C : x^' > 0}, and choose the Loo-norm when 
defining d(-,-), then d(x,F) = and our Proposition 3.3 gives 
a version of Proposition 3.1 in Mitra and Resnick [2010]. 

(b) For considering regular variation on the cone E n : = [0, oo] x 
(0, oo], Heffernan and Resnick [2007, Proposition 4] give a de- 
composition of their limit measure //*(•) by applying the trans- 
formation T : (x,y) i y (y,x/y), If we choose C = [0,oo) 2 , F = 
[0,oo) x {0} and O = [0,oo) x (0,oo) =: D n , and define d(-, •) 
using the Loo-norm, then d((x, y), F) = y and our Proposition 3.3 
connects with Heffernan and Resnick [2007, Proposition 4]. 

(c) Proposition 3.3 also relates to the usual polar coordinate char- 
acterization of multivariate regular variation on E as in Resnick 
[2007, page 173] . Set F = {0} which is a closed cone in C = [0, oo) d 
and d(x,{0}) = \\x\\. See also Proposition 8.2. 

3.3. Hidden regular variation. As in Definition 3.1, consider F C C C 
[0, oo) d with F and C closed cones containing {0}. Suppose Fx is another 
subset of C that is a closed cone containing {0}. Then FUFi is also a closed 
cone containing {0}. Set O = C \ F and Oi = C \ (F U Fi). 

Definition 3.6. The distribution of a random vector Z E C that is 
regularly varying on O with scaling function b(t) in (4) possesses hidden 
regular variation (HRV) on ©i if 

1. The distribution of Z is also regularly varying on Oi with scaling 
function b\(t) and limit measure v\ and 

2. b{t)/b\(t) — > oo as t ->■ oo. 

Observe that the condition b(t)/bi(t) — > oo implies v puts zero mass on 
Oi. (See Resnick [2002].) From Definition 3.6 and (5), it follows that there 
exists a\ > a such that &i(-) € RV\/ ai and on Oi, the limit measure 
in (4) satisfies the scaling property 

(8) vx{c-) = c" ai c>0. 

Example: Let Z = (Z^Z 2 ) be iid unit Pareto random variables. Then 
the distribution of Z is regularly varying on D with b(t) = t and possesses 
HRV on (0, oo) 2 with b x (t) = y/t. Somewhat more generally, if Z = (Z 1 , Z 2 ) 
has regular variation on D = [0, oo) 2 \ {0}, then in the presence of asymp- 
totic independence, HRV offers non-zero estimates of joint tail probabilities 
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P[Z l > x, Z 2 > y] for large thresholds x, y > 0, whereas regular variation on 
D estimates joint tail probabilities as zero. Other examples are considered 
in Section 5. 

Remark 3.7. We make a few remarks on Definition 3.6. 

(i) There is flexibility in choosing Oi and this flexibility is useful for defin- 
ing HRV on a sequence of cones. Cones can be chosen based on the 
risk regions whose probabilities are required. For example, if d = 2, 
we choose the cones D and D^ 2 ) := {z € [0, oo) d : z 1 A z 2 > 0} if we 
need the probability that components of the risk vector simultaneously 
exceed thresholds. 

(ii) Differences with existing notions of hidden regular variation: Previous 
considerations of HRV relied on vague convergence and compactifi- 
cation and were applied to specific choices of cones. Resnick [2002], 
Heffernan and Resnick [2005], and Maulik and Resnick [2005] con- 
sider HRV on (0, oo] 2 and Mitra and Resnick [2010] consider the cone 
E^) = {x € [0, co] d : x^ > 0}. The choice of these specific cones may 
not provide sufficient flexibility and generality. For example, to esti- 
mate P[\X — Y\ > x] when asyptotic full dependence is present, such 
cones considered previously are of no help. See Example 5.2. 

3.3.1. Where to seek HRV. Suppose the distribution of Z is regularly 
varying on O and that the limit measure v in (4) gives zero mass to a 
subset R of O. Using the asymptotic property of regular variation to estimate 
P[Z € tR] for large t, means such an estimate is 0. So we seek another regular 
variation on a subset of R which is of lower order. 

Thus, when seeking HRV our focus is on subsets of O where the limit 
measure v{-) gives zero mass. A systematic way to find HRV is facilitated 
by the following simple remark. 

Proposition 3.8. In Definition 3.1, the support of the limit measure v 
is a closed cone F v C C containing 0. 

Proof. Let supp(z^) denote the support of v. By definition, supp(^) is 
closed. Let x 6 supp(z^) and we show for t > that tx £ supp(V). For small 
5, by (5) 

v((tx - si,tx + si) n c) = u(t((x - -i,x + -i)nc)j 
=t~ a u{{x - -i,x + -i)nc) > o 
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since x G supp(i^). □ 

So ¥ u = supp(z^) is a union of rays emanating from the origin. It is also 
true that 

supp(^) = {t ■ supp(S'o), t > 0}. 
When seeking HRV on a cone smaller than O, we conclude that 

0„ := C \ (F U ¥ u ) 

is the largest possible sub-cone of O where we might find a different regular 
variation. In practice, guided by the type of risk region whose probability 
we need to estimate, we find a closed cone Fi C C containing such that 
Fx D ¥ u and set Oi = C \ (F U Fi) and then seek regular variation on 
©i. Possibly, but not necessarily Fi = supp(V). Examples are in Mitra and 
Resnick [2010] and Section 5. 

3.3.2. Regular variation on a sequence of cones. Having found regular 
variation on O with HRV on Oi, we ask: should we stop here? There might 
be a subcone ©2 of ©1, where v\{-) gives zero mass and hence, there might 
exist a different regular variation on ©2. 

To proceed further, as before remove the support of v\ from ©1 and 
consider the set 

V1 := ©1 \supp(i/i) 

and Ul is the largest possible sub-cone of ©i where we might find a different 
regular variation. So we choose F2 D supp(^i) and set ©2 = C \ (F U Fi U 
F2) and seek regular variation on ©2 with scaling function hi (t) such that 
bi(t)/b2(t) — > 00 as t — > 00. This last condition guarantees the regular 
variation on ©2 is of lower order than the regular variation on either © or 
©1 and hidden from both higher order regular variations. This process of 
discovery is continued as long as on each new cone regular variation is found. 
Example 5.3 shows this discovery process may lead to an infinite sequence 
of cones. 

From our definition of HRV, at each stage of the discovery process we have 
some flexibility in choosing the next cone where we seek HRV. Example 5.3 
shows it may be impractical to analyze HRV on every possible cone as the 
discovery process may lead to an infinite sequence of cones. A more practical 
approach is to decide on a particular finite sequence of cones based on the 
risk regions of interest; see Remark 3.7(i). For example, if we are interested 
in estimating joint tail probabilities, we might consider only the sequence of 
cones D = [0,oo) d \ {0} D D( 2 ) = {x G [0,oo) d : > 0} D • • • D DC* = 
{x g [0,oo) d : > 0}; cf. Mitra and Resnick [2010]. 



HIDDEN RISKS 



15 



4. Remarks on other models of multivariate regular variation. 

Despite the fact that most common examples in heavy tail analysis start by 
analyzing convergence on the cone [0,oo) d \ {0}, this need not always be 
the case. For example, the standard case of the conditional extreme value 
(CEV) model [Heffernan and Resnick, 2007, Das and Resnick, 2011], is reg- 
ular variation (4) with b(t) = t on the cone D n := O = [0, oo) x (0, oo) with 
C = [0, oo) 2 and F = [0, oo) x {0}. 

4.1. The CEV model. The conditional extreme value (CEV) model, sug- 
gested in Heffernan and Tawn [2004] , is an alternative to classical multivari- 
ate extreme value theory (MEVT). In contrast with classical MEVT which 
implies all marginals are in a maximal domain of attraction, in the CEV 
model only a particular subset of the random vector is assumed to be in a 
maximal domain of attraction. For convenience, restrict attention to d = 2. 

The CEV model as formulated in Heffernan and Resnick [2007], Das and 
Resnick [2011] allows variables to be centered as well as scaled. To make 
comparison with models of regular variation on the first quadrant easy, we 
recall the vague convergence definition using only scaling functions. 

Definition 4.1. Suppose Z := (£, rf) e is a random vector and 
there exist functions ai(t),a2(t) > and a non-null Radon measure /i on 
Borel subsets of E n := [0,oo] x (0, oo] such that in M + (E n ) 



Additionally assume that /i satisfies the following non-degeneracy condi- 
tions: 

(a) ^([0,x] x (y,oo]) is a non-degenerate distribution in x, 

(b) n([0,x] x (y,oo\) < oo. 

Also assume that 

(c) H(x) := fi([0,x] x (l,oo]) is a probability distribution. 

In such a case Z satisfies a conditional extreme value model and we write 
Z e CEV( ai ,a 2 ). 

The general CEV model, provided the limit measure is not a product, 
can be standardized to have standard regular variation on the cone E n [Das 
and Resnick, 2011, pg. 236]. Following the theme of Examples 1 and 2 at 
the beginning of Section 3, if no mass exists on the lines through oo, and 
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0-1 = 0.2, then the vague convergence definition of the CEV model on En is 
the same as the M* definition on regular variation D n - 

The issue of mass on the lines through oo is significant since if mass 
on these lines is allowed, there is a statistical identifiability problem in the 
sense that in E n it is possible to have two different limits in (9) under two 
different normalizations and under one normalization, there is mass on the 
lines through oo and with the other, such mass is absent. Restricting to Dn 
resolves the identifiability problem as in this space, limits are unique. See 
Example 5.4. 

4.2. Non-standard regular variation. Standard multivariate regular vari- 
ation on E requires the same normalizing function to scale all components 
and is a convenient starting place for theory but unrealistic for applica- 
tions as it makes all one dimensional marginal distributions tail equivalent. 
Non-standard regular variation [Resnick, 2007, Section 6.5.6] allows differ- 
ent normalizing functions for vector components and hence permits each 
marginal distribution tail to have a different tail index. When the com- 
ponents of the risk vector have different tail indices, non-standard regular 
variation is sensitive to the different tail strengths. On E or D, non-standard 
regular variation takes the form 



for scaling functions etj(t) f oo, i = 1, . . . , d, where convergence is vague for 
E and in M* for D. If convergence is in E and there is no mass on the lines 
through oo, the difference between convergence in E and D evaporates. 

In cases where ai(t)/ai + \(t) — > 0, it is sometimes possible to compare the 
information in non-standard regular variation with what can be obtained 
from HRV. Sometimes HRV provides more detailed information. Consider 
the following 

Example 4.2. Suppose X\, X 2 , X3 are independent random variables 
where X\ is Pareto(l), X2 is Pareto(3) and X% is Pareto(4). Further assume 
that B is a Bernoulli(l/2) random variable independent of X\,X2,X%. De- 
fine 



(10) 



tP[{Z l / ai {t),i 



1 



...,d)€-] -H/(0 



Z = {Z\ Z 2 ) := B(Xx,X 3 ) + (1 - B){X 2 , X 2 ). 
Non-standard regular variation on E or D is given by 



tP 
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where eo indicates the point measure at and the limit measure concentrates 
on the two axes. Now HRV can also be sought under such non-standard 
regular variation and we get 



tP 



( z x (z 2 y 



1 



-x dxAy dy 



on the space K^ 2 \ Note that, this form of regular variation completely ig- 
nores the existence of the completely dependent component of Z given by 
(X2,X2). Alternatively, if we pursue regular variation and HRV on a se- 
quence of cones as defined in this paper then we observe the following con- 
vergences as t — > oo: 



1. On D, we have 
tP 



Z 1 Z 2 
t ' t 



E dx dy 



*x 2 dxe (dy). 



2. In the next step on D \ {x-axis}, we have 



tP 



(Z^ Z 2 ^ 



E dx dy 



3x A dxe x (dy). 



3. Next, on D \ [{x-axis} U {diagonal}], we have 



tP 



Z?_ 



E dx dy 



-e (dx)4y 5 dy. 



4. Finally, on D \ [{x-axis} U {diagonal} U {y-axis}], we have 



tP 



E dxdy 



1 



x 2 dx 4y 5 dy. 



Clearly, this analysis captures the structure of Z better than what 
non-standard regular variation along with HRV in the classical set-up. 

Thus, in Example 4.2, HRV provides more information than non-standard 
regular variation. This is not always the case and sometimes non-standard 
regular variation is better suited to explaining the structure of a model. 

Example 4.3. [Resnick, 2007, Example 6.3] Suppose X is a standard 
Pareto random variable and Z = (X, X 2 ). Using the obvious non-standard 
scaling for the coordinates leads to 



11) 



tP 



X X^_ 



"(1) 



oT" 



(as t — > oo) 
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where T : (0, oo] — > (0, oo] x (0, oo] is defined by T(x) = (x,x 2 ) and 
vn-\{dx) = x~ 2 dx, x > 0. The limit measure concentrates on {(x,x 2 ) : x > 
0}. Using the same normalization on both coordinates is not so revealing. 
With the heavier normalization, we have on M*([0, oo) 2 , [0,oo) 2 \ {0}), 

(12) tP[Z/t 2 e •] 4 e x U(i), (ast^oo) 
and with the lighter normalization and x > 0, y > 0, 

P[X/t > x,X 2 /t > y] -»• x- 1 , Vy>0, 

so that 

(13) tP[Z/t G •] 4 v {1) x eoo , on E . 

Neither (12) nor (13) approach the explanatory power of (11). Moreover, 
since our modeling excludes points at infinity, the convergence in (13) is not 
equivalent to any M*-convergence. 

5. Examples. The definition of HRV given in this paper changes some- 
what the definition of convergence but more importantly allows general 
cones compared with the existing notion of HRV [Resnick, 2002, Mitra and 
Resnick, 2010]; see Remark 3.7 and equation (8.2) of this paper. Here we 
provide examples to illustrate use and highlight subtleties. The examples 
give risk sets, whose probabilities can be approximated by using our general 
concept of HRV, and not the existing notion. See also [Mitra and Resnick, 
2010]. 

Example 5.1. Diversification of risk: Suppose, we invest in two fi- 
nancial instruments I\ and and for a given time horizon future losses as- 
sociated with each unit of I\ and I2 are £ and 77 respectively. Let Z = (£, 77) 
be regularly varying on O = O = [0, co) 2 \{0} with limit measure v(-). We 
earn risk premia of $l\ and $fa for investing in each unit of I\ and I2. 

Suppose we invest in a% units of I\ and ai units of 12- A possible risk 
measure for this portfolio is P[ai£ > x^a^f] > y] for two large thresholds 
x and y and this risk measure quantifies tail-dependence of £ and 77. The 
greater the tail-dependence between £ and 77, the greater should be our 
reserve capital requirement so that we guard against the extreme situation 
that both investments go awry. For this risk measure, the best circumstance 
is if risk contagion is absent; that is, £ and 77 are asymptotically independent 
so that the measure v{-) is concentrated on the axes [Resnick, 2007, page 
192] since then P[a±£ > x, 0277 > y] is estimated to be zero if HRV is absent 
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and even if HRV exists on the cone (0, oo) 2 according to Definition 3.6, the 
estimate of -P[ai£ > x, a^r] > y] for large thresholds x and y should be small 
compared to the case where £ and r] are not asymptotically independent. 

In place of asymptotic independence, suppose instead that Z is regularly 
varying on D as in Definition 3.1 with limit measure v(-) and v(-) has support 
{(u, v) € © : 2u < v} U {(u, v) € O : u > 2v} so that v{-) puts zero mass on 

CONE : = {(u, v) £B :2u> v,2v > u} 
(14) = [J {(u, v) : 2u - v > x,2v - u > y}. 

x>0,y>0 

We can still build a portfolio of two financial instruments that have asymp- 
totically independent risks as follows. 

Define two new financial instruments W\ = 21\ — I2 (buy two units of 
I\ and sell a unit of I2, assuming such transactions are allowed) and W2 = 
2I2 — h- The loss associated with W\ is Lw\ '■= 2£ — r\ and the loss for W2 
is Lyy 2 := 2rj — £. We earn the same risk premia a\l\ + 02^2 in the following 
two cases: 

(i) invest in a\ units of I\ and 02 units of I2, or 

(ii) invest in c\ = (2a\ + a2)/3 units of W\ and C2 = (a± + 2a2)/3 units of 
W 2 . 

A measure of risk of the portfolio in (i) is P[a\^ > x, a2i] > y] and since 
as t — > 00, 

tP[a^/b(t) > x,a 2 r}/b(t) > y] -»■ v{((x, y), 00)) > 0, 

since asymptotic independence is absent, we expect the risk probability to 
be not too small. However, the risk measure for (ii) should be rather small 
as we now explain. Let T(u, v) = (2u — v , 2v — u) and the risk measure for 
(ii) is 

P[ci(2£-77) >x,c 2 (2r ? -£) > y] = P[T^, V ) > (x/cj, y/c 2 )\. 
Since as t — > 00, 

tP[T(Z, V ) > (b(t)x/ Cl ,b(t)y/c2)} -> v{t~ 1 (({x I c x ,y/c 2 ), 

and 

T' 1 [{{x/ c u y I c 2 ), 00)) C CONE, 

the risk measure for (ii) is small and the losses are asymptotically indepen- 
dent. Hence, investment portfolio (ii) above achieves more diversification of 
risk than portfolio (i) , and both earn the same amount of risk premium. 
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How do we construct a risk vector Z whose distribution is regularly 
varying and whose limit measure v concentrates on D \ CONE? Suppose 
i?2, U\, U 2 , B are independent and R\ is Pareto(l), R 2 is Pareto(2), 
Ui ~ U((0, 1/3) U (2/3,1)), J7 a ~ [7(1/3,2/3) and 5 is Bernoulli with values 
0, 1 with equal probability. Define 

Z = BRi(U 1: 1 - Ut) + (1 - B)R 2 (U 2 , 1 - 17 2 ). 

Because of Proposition 3.3 applied with the Li metric, Z is regularly varying 
on D with index 1 and angular measure concentrating on [0, 1/3] U [2/3, 1]. 
Hence the limit measure v concentrates on D \ CONE. At scale i 1//2 , Z is 
also regularly varying on CONE with uniform angular measure. 

Example 5.2. Asymptotic full dependence: For convenience, re- 
strict this example to d = 2. HRV [Resnick, 2002] was designed to deal with 
asymptotic independence [Resnick, 2007, page 322] where v(-) concentrates 
on the axes. For asymptotic full dependence, the limit measure u(-) concen- 
trates on the diagonal DIAG : = {(z,z) : z> 0} [Resnick, 2007, page 195] 
and previous treatments could not deal with this or related degeneracies 
where the limit measure v(-) concentrates on a finite number of rays other 
than the axes. 

Consider the following example. Suppose, X\, X 2 , X3 are iid with common 
distribution Pareto(2). Let B be a Bernoulli random variable independent 
of {Xi : i = 1, 2, 3} and P[B = 0] = P[B = 1] = 1/2. Construct the random 
vector Z as 

Z = (£,77) = B^Xr) 2 , {X l ) 2 ) + (1 - B)(X 2 ,X 3 ) 

and Z is regularly varying on O = D with scaling function b(t) = t and limit 
measure v where, 

u([0,{u,v)} c ) = ^(uAv)- 1 (u,v)EB. 

The measure v(-) concentrates on DIAG and satisfies v({(u, v) SO : \u— v\ > 
x}) = 0, for x > and as a result, we estimate as zero risk probabilities like 
B(\S, — v\ > x) for large thresholds x. We gain more precision from HRV. 
Define the cone 

Oi = [0, oo) 2 \ ({0} U DIAG) = {(n, v) £ D : \u - v\ > 0} . 

The distribution of Z has HRV on Oi with scaling function b\(t) = t 1 / 2 and 
limit measure 

v^dv^dv) = u~ 3 e m ^ )x{0}) {du,dv)+u- 3 e, \(du,dv), (u,v) £ ©i, 
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the measure that concentrates mass on the axes and which is restricted 
to Oi. This measure results from the second summand in Z, namely (1 — 
B)(X2, X3); the first summand B(Xf,Xf) contributes nothing to the limit 
due to the restiction to 0>i. So for instance, for (u,v) E Oi, x > 0, 



Statistical estimates of the risk region probability replace b\ (t) by a statistic 
as in Section 6. 

The fact that z^i(-) concentrates on the axes suggests seeking a further 
HRV property on a cone smaller than Oi. If one is needs risk probabilities 
of the form P(£ — 7/ > x,rj > y) for large thresholds x and y, we seek HRV 
property, say, O 2 = {(u, v) G Oi : u, v > 0} or a sub-cone of CD 2 . 

As an example of why risk probabilities like P(£ — rj > x) arise, imagine 
investing in financial instruments I\ and I2 that have risks £ and rj per unit 
of investment and suppose these risks have asymptotic full dependence. 

For any a\,a2,c > 0, asymptotic full dependence of £ and 77 implies 
-P(ai£ + air] > x) should be bigger than P(c(£ — rj) > x), provided x is 
large. So, if l\ > I2, it is less risky to invest in the financial instrument 
I\ — I2 rather than investing in both I\ and 12- Obviously, investing in the 
financial instrument I\ — I2 requires us to measure risks associated with 
this portfolio, which leads to the need to evaluate P(£ — ij > x) for large 
thresholds x. 

In summary, this example shows how a more flexible definition of HRV 
possibly allows computation of risk probabilities in the presence of asymp- 
totic full dependence. 

Example 5.3. Infinite sequence of cones: HRV was originally de- 
fined for d = 2 and for two cones [Resnick, 2002] and then extended to a 
finite sequence of cones [Mitra and Resnick, 2010]. In this paper our defi- 
nition of HRV allows the possibility that we progressively find HRV on an 
infinite sequence of cones. We exhibit an example for d = 2 where this is 
indeed the case. An infinite sequence of cones may create problems for risk 
estimation which we discuss afterwards. 

Suppose {Xi,i > 1} are iid random variables with common Pareto(l) 
distribution. Let {Yi,!^} be iid with common Pareto(2) distribution and 




and for some large t > 0, letting u ! 0, v I 0, we see 
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suppose {Bi,i > 1} is an infinite sequence of random variables with P(P« = 
1) = 1 - P(Bi = 0) = 2 -i and YaLi B i = l - (For instance, let T be the 
index of the first success in an iid sequence of Bernoulli trials and then set 
Bi = l[T=i],i > 1.) Assume that {Xi,i > 1}, {Yi,!^} and {Bi : i > 1} are 
mutually independent. Define the random vector Z as 

Z = (C,V) = B 1 (Y 1 ,Y 2 )+J2B i+ i ^-\Xi)^-^ . 

i=l ^ ' 

So, Z has regular variation on the cone O = Oo = D = [0, oo) d \{0} with 
index of regular variation a = 1, scaling function b(t) = t, limit measure u(-) 
concentrating on the diagonal DIAG := {(x, x) : x £ [0, oo)}. So, we remove 
the diagonal and find HRV on Oi = D\DIAG with &i(i) = t 2 / 3 , a\ = 3/2 
and limit measure v\ concentrating on the ray {(x,2x) : x > 0}. Progres- 
sively seeking HRV on successive cones, we find at the (i + l)-th step of our 
analysis, Z has regular variation on the cone 

(15) O, = D\ [U) =1 {(x, 2 j ~ 1 x) :xe[0, oo)}] 

with the limit measure Vi{-) and the index of regular variation a« = 2 — 2~\ 
The limit measure z^(-) concentrates on {(x,2 t x) : x G [0, oo)}. 

Selection of cones must be guided by the type of risk probability needed. 
Consider trying to estimate P(£ — rj > x) for large thresholds x using the 
cones Oj, i > given in (15). At the (i + l)st stage, using cone Oj, the limit 
measure Vi(-) puts zero mass on the cone {(u,v) : u > v}. So, even after a 
million HRV steps, we will estimate P(£ — r/ > x) for large thresholds x as 
zero, which is clearly wrong due to the definition of Z since 

P[£ - V > x] > P[Bi = l]P\Yi -Y 2 >x]>0. 

An alternative procedure seeks regular variation on the cone {(u,v) : u > v} 
and this leads to somewhat more reasonable estimates of P(£ — rj > x) for 
large thresholds x since in this case the regular variation with the Pareto(2) 
variables is captured. 

The moral of the story is that the choice of sequence of cones when defining 
HRV should be guided by the kind of risk sets considered. For example, if we 
are only interested in joint tail probabilities, a possible choice of sequence 
of cones is D = D D^ 2 ) D • • ■ D , where 

D (/) = {x G [0,oo) d : > 0}, 

and recall x^> is the Z-th largest component of x. This special case is dis- 
cussed in Mitra and Resnick [2010]. 
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Example 5.4. The CEV model and mass on the lines through 

oo. If we consider the CEV model on E n , there can exist two different limits 
in (9) under two different normalizations. This problem disappears if we 
restrict convergence to D n . 



Suppose Y is Pareto(l) and B is a Bernoulli random variable with P[B = 
1] = p[B = 0] = 1/2. Define 



Then the following convergences both hold in En: for x > 0, y > 0, 



So Z follows a CEV model on E n with two different scalings. Note that v\ 
does not put any mass on lines through oo, but does: ^({oo} x (y, oo]) = 
l/2y. If we restrict convergence to Dm limits are unique and Z is regularly 
varying on D n with limit measure v\ given by (16) restricted to D n . 

6. Estimating the spectral measure and its support. We have 
defined regular variation on a big cone Oo C M rf along with hidden regu- 
lar variation in a nested sequence of subcones Oo 3 Oi 3 O2 D . . .. We 
now propose strategies for deciding whether HRV is consistent with a given 
data set and, if so, how to estimate probabilities of sets pertaining to joint 
occurence of extreme or high values. We proceed as follows: 

1. Specify a fixed finite sequence of cones pertinent to the problem, and 
seek HRV sequentially on these cones. We discuss this in Section 6.1 
which follows ideas proposed in [Mitra and Resnick, 2010, Section 3]. 

2. If the sequence of cones is not clear, proceed by estimating the support 
of the limit measure at each step, removing it, and seeking HRV on 
the complement of the support. Then the hidden limit measure is 
estimated using semi-parametric techniques similar to 6.1. 

6.1. Specified sequence of cones. Suppose Z%, Z2, ■ ■ ■ , Z n are iid random 
vectors in C C [0, oo) d whose common distribution has a regularly varying 



z = (£,n) = b(y,y) + (i-b)(Vy,y). 



(17) 



(16) 
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tail on O according to Definition 3.1 with normalizing function b(-) and 
limit measure v{-)- Also assume that we have a specified sequence of cones 
O = Oo D Oi D O2 D . . . where we seek regular variation. Such a sequence 
of cones is known and fixed. 

We provide an estimate for the limit measure of regular variation on O and 
the same method can be applied to find limit measures for hidden regular 
variation on the subcones. 

Now, according to Corollary 3.4 regular variation on O as above is equiv- 
alent to assuming P[d(Z,¥) > x] is regularly varying at 00 with some 
exponent a > and normalizing function b(t) which we take as b(t) := 
^^"(1 — 1/t) where d(Z,¥) has distribution function Fd and 



(18) P 



d(Z,¥) 



d(Z,¥) > t 



So(-) (t-too), 



in P((?Kq), the class of all probability measures on 9Nq = {a; € O : d(x, F) = 
1}. Thus we estimate v by estimating a and Sq separately. Considering 
(if := d(Z\,¥), . . . , d\ = d(Z n ,¥) as iid samples from a regularly varying 
distribution on (0,oo), the exponent a can be estimated using the Hill, 
Pickands or QQ estimators [Resnick, 2007]. 

Here is an outline of how to obtain an empirical estimator of So following 
[Resnick, 2007]. 

Proposition 6.1. Assume the common distribution of the iid random 
vectors Zi, . . . , Z n satisfies Definition 3.1 and (4). As n — > 00, k — > 00, 
n/k — > 00, we have in P((9Ho), 

n 

(19) S n (.) := * =1 ^ ''I /l /l> =* So(-). 

E tcFjbin/k^ 1 ' 00 ) 
i=l 

Proof. Since 

{df, 1 < i < n} are iid regularly varying random variables 
from some distribution on (0, 00) with norming function b(t) which can 
be chosen to be b(t) = Ff~(l — 1/t), by Theorem 8.1. Thus for x > 0, 
lP[d ¥ Jb{n/k) > x] -> cx~ a , and from Resnick [2007, page 139] this is 
equivalent to | Yli=l e d ¥ /b(n/k)(^^°°) ^ c ' an d to prove (19), it suffices to 
show in M + (<9No)j 



1 - 

( 20 ) 1 Yl e Z l /d B S-) l [ l fJb{n/k)>l] S o(')- 



k 
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The counting function on the left of (20) only counts Zi/dJ such that 
dj/b(n/k) > 1. The distribution of such random elements is P[Zi/dJ G 
■\dj/b(n/k) > 1], [Resnick, 2008, page 212] and (18) holds. Using Resnick 
[2007, Theorem 5.3ii, page 139] and the style of argument in Resnick [2008, 
page 213], we get (20). □ 

The estimator S n of Sq in Proposition 6.1 relies on b(t) which is typically 
unknown but b(n/k) can be estimated. Order dj, . . . , d^ as dj^ > . . . > dj n ^ 

and dj k+1 ^/b(n/k) —> 1 so dj k+1 \ is a consistent estimator of b{n/k) as n — > 
oo,k — > oo, n/k — > oo [Resnick, 2007, page 81]. Hence we replace b(n/k) by 
djk+i) an d propose the estimator S n for Sq in S n as follows: 

n 

S n(0 := ^ = ^L 1 K/^ +1) >i] e ^/<(-)- 



Proposition 6.2. As n— >■ oo,k -^,n/k ->■ oo, => So in P(cMo)- 

Proof. The proof is a consequence of the continuous mapping theorem 
and Proposition 6.1. For details see, for instance, [de Haan and Resnick, 
1993]. □ 

Thus when Z\, Z<i, • • • , Z n are iid random vectors in C C [0, oo) rf which 
have a regularly varying distribution on O, we can estimate both a and 
the spectral measure Sq. If we have a specified finite sequence of cones 
O := Oo 3 Oi 3 O2 D ...O m , then we sequentially estimate the limit 
measure by separately estimating the spectral measure and the index «j. 

6.2. Support estimation. Suppose Z\, Z2, ■ ■ ■ , Z n are iid random vectors 
in C C [0, oc) d whose common distribution is regularly varying on O accord- 
ing to Definition 3.1 with normalizing function b(-) and limit measure v(-). 
Without a sequence of cones where hidden regular variation can be sought, 
the task of exploring for appropriate cones where HRV may exist is chal- 
lenging. One clear strategy is to identify the support of u, which we call 
supp(z^), and then seek HRV on the complement of the support. Since 

(21) supp(^) = {t ■ supp(S ), t > 0}. 

it suffices to determine the support of Sq. 

We propose estimating the support of the spectral measure Sq with a 
point cloud; that is, a discrete random closed set. 
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Proposition 6.3. Suppose Z\,Zi,...,Z n are iid random vectors in 
C C [0, cc) d whose common distribution is regularly varying on O with nor- 
malizing function &(•) and limit measure As n — >■ oo, k — > oo, n/k — > oo, 

(22) sup Pk n = 1^ : df > d[ fc+1) , i = 1, • • - , n j supp{S Q ). 

Convergence in (22) occurs in the space of closed sets under the Fell 
topology or the space of compact sets in the Hausdorff topology [Molchanov, 
2005]. 

Proof. To show (22), it suffices from [Molchanov, 2005, Proposition 6.10, 
page 87] to show for any h G C^(d'Ro) that 
(23) 

E^sup j/i (^jjf^ '■ dj > ^(fc+i)> 1 - i - n^—t-sup {h(x) : x G supp(5 )}. 
From Proposition 6.2, 

1 - 

i=l 

and from the continuous mapping theorem, for any h G C^(9Nq), we get in 
-P(M), the class of probability measures on M, 

1 ™ 

(24) S n oh~ 1 = -Y, 1 [</^ +1) ] e fc(^/«?)(") 5 ° ° 

If i^ n ,n > are probability measures on R with bounded support and 
F n =^ _F then 

(25) xp„ ■= sup {x : F n (x) < 1} — >• sup {x : F(x) < 1} =: xp. 

X X 

Applying this remark to (24) and using the continuous mapping theorem 
yields as n — > oo, k — > oo, n/k — > oo, 

(26) 

sup j/i : d J > rf (fc+i)' 1 < « < "-j =^ sup {h(x) : x G supp(5 )}. 

Since h G C^(c^o) is always bounded above, use dominated convergence 
applied to convergence in distribution to get the desired (23). □ 
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Proposition 6.3 provides an estimate of supp(5o) and hence supp(z^). In 
principle, we can remove the estimated support from O and look for hidden 
regular variation in the complement. How well this works in practice remains 
to be seen. For one thing, the estimated support set of Sq is always discrete 
meaning that the estimated support of v is a finite set of rays. With a 
large data set, we might be able to get a fair idea about the support of 
the distribution and where to look for further hidden regular variation. If 
there were reason to believe or hope that the support of So were convex, 
our estimation procedure could be modified by taking the convex hull of the 
points in (22). 

7. Conclusion. Our treatment of regular variation on cones which is 
determined by the support of the limit measures unifies under one theoreti- 
cal umbrella several related concepts: asymptotic independence, asymptotic 
full dependence, and the conditional extreme value model. Our approach 
highlights the structural similarities of these concepts while making plain 
in what ways the cases differ. Furthermore, the notion of M*-convergence 
introduced in Section 2.2 provides a tool to deal with the generalized notion 
of regular variation given here. Generalizing this notion of convergence and 
analyzing its properties admits potential for further research. 

It is always an ambitious undertaking to statistically identify lower order 
behavior and this project has not attempted data analysis or tested the fea- 
sibility of the statistical methods discussed in Section 6. It is clear further 
work is required, particularly for the case where the support of the limit 
measures must be identified from data. One can imagine that for high di- 
mensional data whose dimension is of the order of hundreds, sophistication 
is required to pursue successive cones where regular variation exists. 

8. Appendix. 

8.1. Regular variation on E := [0,oo] d \ {0} vs D = [0, oo) d \ {0}. We 
verify that the traditional notion of multivariate regular variation given in 
(1) on E is equivalent to Definition 3.1 if we choose C = [0, oo) d and F = {0}. 
This yields O = D. 

Theorem 8.1. Regular variation on D according to Definition 3.1 is 
equivalent to the traditional notion of multivariate regular variation given 
in (1) and the limit measures v(-) of (4) and //(•) of (1) are equal on D. 
Moreover, //(•) puts zero measure on E \ D. 

Proof. First we show that the standard notion of multivariate regular 
variation on E given in (1) implies (4) in M*(D). Let v(-) be a measure 
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From Resnick [2007, page 176], we get that 
^ and non-degenerate, u(-) ^ and non- 



on O such that v{-) = //(• 
/i(E\D) = 0. So, since //(• 
degenerate. 

For BcD, note that dB = B\B° is defined with respect to the relative 
topology on B and hence dB C B. Thus, v{dB) = implies n(dB) = 0. Also, 
since [0,00]^ is a compact space, any set B C O bounded away from {0} 
is a relatively compact set in E [Resnick, 2007, page 171, Proposition 6.1]. 
Therefore, by definition, u(-) € M*([0, oo) d , B) and by (1), for any B C B 
bounded away from {0} and v{dB) = 0, 



tP 



e B 



KB) = v(B). 



So, (4) holds with C = [0, 00) , D = B, and b is the same as in (1) and v is 
the restriction of ju to D. 

Conversely, we show that Definition 3.1 and (4) with O = B implies the 
traditional notion of multivariate regular variation on E in (1). Define a 
measure /z(-) on E as //(•) = v{- n D). A relatively compact set B of E 
must be bounded away from {0} [Resnick, 2007, page 171, Proposition 6.1]. 
So, from definition of /x(-), it is Radon. Note that dB = B\B° is defined 
with respect to the topology on E, but d{B n B) is defined with respect 
to the relative topology on B. Also from the definition of /u(-), n(dB) = 
implies u(d(BnB)) = v(dBnB) = n(dB) = 0. Therefore, from (4), for any 
relatively compact set B of E such that n(dB) = 0, as t — )■ 00, 



tP 



e B 



tP 



b(t) 



€ B n. 



u(BHB) = n(B). 



The first equality above holds since Z £ [0, oo) d . Hence, vague convergence 
in (1) holds with the same b as in (4) and with /i as the extension of v from 
B to E. □ 



Regular variation on B can also be expressed in terms of the polar coor- 
dinate transformation. As at the begining of Section 8.1, set C = [OjOo) ', 
F = {0} and O = B. 

Proposition 8.2. Regular variation on O as given in Definition 3.1 is 
equivalent to the following condition: 

-> ^(a) x Sq(A) 



(27) 



tP 



\\Z\\ 
b(t) 



z 

\z\ 



G A 
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for all measurable A C (0, oo) xc)Nq such that A 1 n{0} = and uoh 1 (dA) = 
0, where A 1 is the projection of A on its first coordinate, h(-) is a func- 
tion defined by h : x h-> ( ||sc||, iqt ) , = {x G O : \\x\\ = 1}, S®(-) 



is a probability measure on <9Nq and V( a )(') ^ s a Pcreto measure given by 
ff a )((, x ) °°)) = x ~° S or x > 0. The probability measure Sq(-) is called the 
spectral measure and is related to u(-) by the relation 

(28) S Q (A) = v (ix G O : ||a;|| > 1, G A 

Proof. This is a special case of Proposition 3.3. □ 

8.2. Regular variation on E (i) = [0, oo] d \ {x G E : x w > 0} us D w = 
[0, oo) rf \ G [0,oo) d : x(0 > 0}. Recall is the Z-th largest component 
of aj, / = 1,2, ••• , d. Hidden regular variation using E(0 is considered in 
Mitra and Resnick [2010]. Unlike the situation in subsection 8.1, here limit 
measures can put mass on E w \B(0 as found in Mitra and Resnick [2010]. 
We compare regular variation in E^- 1 using the traditional vague conver- 
gence definition in which the vague convergence in (1) is assumed to hold in 
M + (E^) with regular variation given in (4) in M*(C, O) where C = [0, oo) d , 
F = {x G [0, oo) d : x® = 0} and O = DO = C \ F. 

Theorem 8.3. Regular variation on M*(D(0) is equivalent to the tradi- 
tional vague convergence notion of regular variation in M + (E^) if the limit 
measure //(•) given in the M + (E^) analogue of (1) does not give any mass 
to the set E(0 \D(0. In this case, the limit measures u(-) of (4) and //(•) of 
(1) are equal on D(0. 

Proof. Suppose, for a random vector Z, there exist a function &(0 (t) f oo 
and a non-negative non-degenerate Radon measure /u*0(.) ^ on E*0, such 
that in M+(E<0) 



(29) tP 



Z 

G 



6(0 (t) 



and the limit measure fJ-^(-) does not give any mass to E^ \1D)(0. Define a 
measure x(') on D(0 as x(') = M (")■ Since //0(.) ^ is non-negative, non- 
degenerate and //W(]e(0 \]Q)(0) = o, the measure x( - ) 7^ is non-negative and 
non-degenerate. The subsets of B(0 bounded away from (B«) c = [0,oo) d \ 
D(0 are relatively compact in E^0. Therefore, using the fact that //0(-) is 
Radon and the definition of x(-), it follows that %(•) gives finite measure to 
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sets bounded away from (D^) c . From the definition of M*-convergence, it 
follows that Z satisfies (4) with the scaling function &(•) = fe^(-) and the 
limit measure u(-) = x(')- 

Conversely, suppose a random vector Z satisfies (4) in M*(C, O) with 
C = [0, oo) d and O = D^. Define a measure //(•) on E w as fi(-) = v{- n D w ). 
Since v(-) ^ and is non-negative and non-degenerate, so is fi(-). A subset 
of E^ is relatively compact in iff it is bounded away from {x G [0, oo] d : 
x"> = 0}. Since u(-) gives finite mass to sets bounded away from (B 1 )", 
from the definition of /(/(•), it follows that fi{-) is a Radon measure. From the 
description of the compact sets in E^, it follows that Z also satisfies (29) 
with the scaling function b^(-) = &(•) and the limit measure /U^'(-) = /x(-) 
[Resnick, 2007, page 52, Theorem 3.2]. □ 

The set E w = {x G E w : ||a;|| = oo} is the union of the lines 

through oo . We emphasize that there exist examples of random vectors Z 
which satisfy (29) and the limit measure /x^(-) gives positive measure on 
the set E w \B<?) [Mitra and Resnick, 2010]. 

8.3. Regular variation on E n = [0, oo] x (0, oo) vs Dpi = [0, oo) x (0, oo). 
Recall CEV model from Section 4.1. 

PROPOSITION 8.4. The following are equivalent: 

(i) Z G CEV{bi,02) with limit measure /x(-) and &i ~ 62 tt«t/i 
(30) A* ([0,oo] x {00} U {00} x (0,oo]) = 0. 

(ii) Z is regularly varying on On according to (4) with normalizing func- 
tion b\ and limit measure v which does not concentrate on {0} x (0, 00). 

Also, if either of (i) or (ii) holds then //(•) = u(-) on On- 

Proof, (i) implies (ii): Since 61 ~ b 2 , (9) implies Z G CEV(bi, bi). Now, 
(9) implies that for all relatively compact Borel sets B in Dn C En with 
H(»B) = 0, 



tP 



KB) 



h(t) 

as t — > 00. Clearly B is bounded away from F. Also is non-null and satisfies 
(30). Thus u{-) = fi(-)\o n is non-negative and non-degenerate on D n - Hence 
Z is regularly varying on Dn with limit measure v. The non-degeneracy 
condition (a) for the CEV model implies that \x cannot concentrate on {0} x 
(0,oo). Conversely, if (ii) implies (i) extend v to a measure \i on E n which 
satisfies (30). □ 
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Remark 8.5. We can drop the condition that fx does not concentrate 
on {0} x (0, oo) in statement (ii) of Proposition 8.4, if we drop condition (a) 
from Definition 4.1 of the CEV model. 

References. 

P. Billingsley. Convergence of Probability Measures. John Wiley & Sons Inc., New York, 
second edition, 1999. ISBN 0-471-19745-9. A Wiley-Interscience Publication. 

N.H. Bingham, CM. Goldie, and J.L. Teugels. Regular Variation. Cambridge University 
Press, 1987. 

J. -J. Cai, J.H.J. Einmahl, and L. de Haan. Estimation of extreme risk regions under 
multivariate regular variation. Annals of Statistics, 39(3):1803-1826, 2011. 

B. Das and S.I. Resnick. Conditioning on an extreme component: Model consistency with 
regular variation on cones. Bernoulli, 17(l):226-252, 2011. 

L. de Haan and A. Ferreira. Extreme Value Theory: An Introduction. Springer- Verlag, 
New York, 2006. 

L. de Haan and S.I. Resnick. Estimating the limit distribution of multivariate extremes. 
Stochastic Models, 9(2):275-309, 1993. ISSN 0882-0287. 

J.E. Heffernan and S.I. Resnick. Hidden regular variation and the rank transform. Adv. 
Appl. Prob., 37(2):393-414, 2005. 

J.E. Heffernan and S.I. Resnick. Limit laws for random vectors with an extreme compo- 
nent. Annals of Applied Probability, 17(2):537-571, 2007. 

J.E. Heffernan and J. A. Tawn. A conditional approach for multivariate extreme values 
(with discussion). Journal of the Royal Statistical Society, Series B, 66(3):497-546, 
2004. 

H. Hult and F. Lindskog. Regular variation for measures on metric spaces. Publ. Inst. 
Math. (Beograd) (N.S.), 80(94):121-140, 2006. ISSN 0350-1302. 

H. Joe and H. Li. Tail risk of multivariate regular variation. Methodology and Computing 
in Applied Probability, page in press, 2010. 

O. Kallenberg. Random Measures. Akademie- Verlag, Berlin, third edition, 1983. ISBN 
0-12-394960-2. 

A.W. Ledford and J. A. Tawn. Statistics for near independence in multivariate extreme 

values. Biometrika, 83(1):169-187, 1996. ISSN 0006-3444. 
A.W. Ledford and J. A. Tawn. Concomitant tail behaviour for extremes. Adv. in Appl. 

Probab., 30(1):197-215, 1998. ISSN 0001-8678. 
K. Maulik and S.I. Resnick. Characterizations and examples of hidden regular variation. 

Extremes, 7(l):31-67, 2005. 
A. Mitra and S.I. Resnick. Hidden regular variation: detection and estimation. 2010. URL 

http : //arxiv. org/abs/1001 . 5058. 

I. Molchanov. Theory of Random Sets. Probability and its Applications (New York). 
Springer- Verlag London Ltd., London, 2005. 

Yu.V. Prohorov. Convergence of random processes and limit theorems in probability 

theory. Teor. Veroyatnost. i Primenen., 1:177-238, 1956. ISSN 0040-361x. 
S.I. Resnick. Hidden regular variation, second order regular variation and asymptotic 

independence. Extremes, 5(4):303-336, 2002. 
S.I. Resnick. Heavy Tail Phenomena: Probabilistic and Statistical Modeling. Springer 

Series in Operations Research and Financial Engineering. Springer- Verlag, New York, 

2007. 

S.I. Resnick. Extreme Values, Regular Variation and Point Processes. Springer Series in 



32 



DAS, MITRA AND RESNICK 



Operations Research and Financial Engineering. Springer, New York, 2008. Reprint of 
the 1987 original. 



RiskLab, Department of Mathematics, 

ETH Zurich, 

Ramistrasse 101, 

8092 Zurich, Switzerland 

E-MAIL: bikram@math.ethz.ch 



School of Operations Research and 
Information Engineering, 
Cornell University, 
Ithaca, NY 14853, USA 

E-MAIL: am492@cornell.edu; sirl@cornell.edu 



